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Approximating  Multiple  Ito  Integrals 
With  *'Band  Limited"  Processes 
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Let  n^(*)  denote  a  "wide>band  width"  vector  valued  process.  The 

rtfT  _• 


piqper  is  concerned  with  limits  of 
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(T)L(T,s)n  (s)dTds,  and  for  the 


B*aultiple  integral  case.  For  the  most  important  case,  a  weak  convergence 

f'  -  ^  “  ~ 

result  is  obtained,  and  the  ^correction*^  terms  e^diibited.  The  method  is 
such  that  the  conditions  used  can  readily  be  weakened.  An  application  to 
a  likelihood  functional  and  hypothesis  testing  problem  is  given.  There, 
the  weak  convergence  result  (rather  than  smre  convergence  of  finite  dimen¬ 
sional  distributions)  is  essential  if  the  limit  approximation  is  to  make 
sense  as  an  approximation  to  the  likelihood  functional.  The  correction 
texms  depend  only  on  the  limit  (as  S)  of  the~cbrreiation  function  of 


terms  depend  only  on  the  limit  (as 

the  (rmozmalized)  df(0.  f - 

f)  sw^ 
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Dlst  1  Special 


1.  Introduction.  We  are  concerned  with  the  set  of  problems  introduced 
by  Balakrishnan  in  [1].  Let  the  matrix  valued  kernel  be  such  that 


rfw‘. 

Iq-'O 


s)  I  ds  dt  <  »  for  each  T  <  <»,  and  L(t,s)  =  0  for  s  >  t.  For 


each  fixed  T,  define  the  operator  L  on  L_[0,T]  by  Lf(t) 


=  f  L(t, 
^0 


s)  f(s)ds. 


Then  the  adjoint  operator  L*  is  defined  by  L*f(t)  =  L(s,t)f(s)ds  and 
fT 

CL‘+  L^)f(t)  =  (L(t,s)  +  L'(s,t)) f(s)ds.  Let  (L  +  L*)  be  nuclear  [2]  for 

Jo 

each  T  <  *0.  Then  [2]  for  each  T  <  »,  there  are  such  that  Jlx^|< 

<  **  cl  I  II  is  the  L2[0,T]  norm)  and 


(1.1a)  L(t,s)  +  L'(s,t)  =  Jx.M.(t)K.(s)  ,  0  <  s,t  <  T. 

1 

Hence  for  T  >  t  >  s  >  0, 


00 

(1.1b)  L(t,s)  *  JXiM^(t)K^(s). 

Without  loss  of  generality,  assimie  that  all  L  are  rxr  matrices. 

If  X^(*)  is  a  sequence  of  random  processes  (with  paths  in  some  func¬ 
tion  space),  we  write  X**(.)  ■»  X(.)  to  denote  weak  convergence  [33,(4]  to 
a  process  X(»).  Let  n®(.)  denote  a  •’wide-band”  noise  process  such  that 
as  e  ■>  0  the  process  defined  by 

ft 

(1.2)  n®(s)ds  =  N®(t) 

Jo 

converges  weakly  to  a  standard  Wiener  process  w(*).  The  problem  is  to  find 
the  weak  limits  of  repeated  integrals  such  as 

(1.3)  x®(t)  -  f  dr  r  ds  n®(T)'L(T,s)n^(s). 

Jo  Jo 


We  also  treat  the  case  of  m- repeated  integrals. 


H  V'  ^  *"^’1  fY 


In  [1],  n^(0  was  Gaussian  and  it  was  obtained  from  a  Wiener  process 
in  a  very  particular  way.  Also,  convergence  (in  the  mean  square  sense)  was 
proved  only  for  each  fixed  t.  In  this  paper,  the  problem  is  treated  in  the 
context  of  the  theory  of  weak  convergence  of  measures  [3], [4].  Most  of  the 
results  (including  those  for  the  important  application  of  Section  5)  are  of 
the  weak  convergence  type.  But  some  are  a  combintation  of  weak  convergence 
and  convergence  of  finite  dimensional  distributions.  A  much  broader  class 
of  noise  processes  can  be  dealt  with.  This  is  important  in  applications, 
since  we  should  not  have  to  require  that  the  actual  physical  noise  is  the 
particular  smoothed  functional  of  w(*)  used  in  [1].  (In  [1],  the  n  (•) 
was  such  that  it's  spectral  density  was  1  on  some  interval  [-Mg,Mj,  and 
zero  outside,  where  Mg-*-  «»  as  e  0.) 

Owing  to  the  nature  of  weak  convergence,  a  broad  class  of  path  function¬ 
als  (including  passage  times,  a  particularly  inqportant  case  in  applications) 
of  the  process  x^(*)  converges  in  distribution  to  the  same  functional  of  the 
limit  process.  As  in  [1],  we  apply  the  result  to  the  problem  of  approximating 
a  likelihood  functional  (Section  5)  .  This  problem  demonstrates  the  iiq>ortance 
of  the  weak  convergence  (rather  than  convergence  in  distribution  for  each  t  ). 
The  weak  convergence  method  is  essential ,  if  the  results  of  the  approximation 
are  to  be  used  for  a  sequential  hypothesis  test,  and  it  is  still  important  ev¬ 
en  if  the  test  is  to  be  conducted  at  a  fixed  time  only.  Further  comnents  on 
this  and  related  points  appear  in  Section  5. 


%  *.  A 
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In  the  next  section,  the  noise  model  is  discussed,  and  some  definitions 


collected  in  Section  3.  In  Section  4,  the  weak  convergence  result  is  proved 


first  (for  the  double  integral  case)  when  the  sum  in  (1.1b)  is  finite  and  the 


are  continuous.  Other  results  will  follow  from  this.  The  likelihood 


ratio  problem  appears  in  Section  5,  and  Section  6  outlines  the  method  for  the 


multiple  integral. 


The  results  here  can  also  be  applied  to  the  non-linear 


filtering  problem  dealt  with  by  Ocone  [5],  where  the  filter  is  represented  as 


a  sum  of  multivariate  Ito  integrals,  but  where  the  observation  noise  is  "wide¬ 


band".  It  should  be  clear  that  the  method  is  equally  applicable  to  the  case 


c  £  c 

where  (1.3)  is  replaced  by  j  dxj  ds  n2(T) *L(T,s)nj(s) ,  and  n2(*)  is  not 
the  same  as  n^(«)  (and  also  for  the  analogous  m- multiple  integral) ,  but  for 


simplicity  of  notation,  we  stick  to  the  sinqpler  case. 


The  correction  terms  depend  only  on  the  correlation  funtion  of  the  y(*) 


process  introduced  in  Section  2,  and  thus  are  robust  with  respect  to  the  un¬ 


derlying  noise  model.  Although*  it  will  not  be  pursued,  one  can  use  our  meth¬ 


od  to  deal  with  cases  where  the  kernel  L(»,«)  depends  on  n  (•)  also.  Such 


results  are  an  additional  advantage  of  the  weak  convergence  approach. 


2.  The  Noise  Model.  Suppose  that  y(«)  is  a  zero  mean  stationary  pro- 
cess  and  define  y^(t)  =  y(t/£  ).  If  y(*)  has  spectral  density  S(u)),  then 


y®(»)/e  spectral  density  S(e^u)  .  To  obtain  the  n*'(»)  used  in  [1],  let 


y(*)  be  a  (scalar  valued)  zero  mean  Gaussian  process  with  spectral  density 


1  on  [-M,M]  and  zero  elsewhere,  and  use  y®(»)/e=n^(*  ) .  Note  that  R(t)  = 


Ey(T)y(0)  satisfies 


I  R(T)dT  =  1. 
00 


du)  *  sin  Mt/  itt 
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The  £oxm  y^C*)/e  **  n^C*)  is  a  common  and  useful  way  of  obtaining  a 
'*iflde'’baiid**  process.  The  method  used  here  is  not  restricted  to  the  use  of 
such  a  fbrm.  In  order  to  simplify  the  use  of  published  results,  we  proceed 
as  dEollows  in  the  theorems.  We  let  n®(«)  ®  y^(*)/e,  where  yCO  is  a 
right  continuous  (vector  valued)  process  satis;fying  either  (Al.a)  or  (Al.b) 
below.  After  the  xnroof  of  Theorem  1,  we  state  two  sets  of  more  general  con¬ 
ditions  under  which  the  results  hold.  In  general  y(*)  need  not  be  station¬ 
ary.  One  particular  interesting  case  whi(^  fits  the  conditions  described  af¬ 
ter  Theorem  1  is  (under  impropriate  assumptions  on  h  (•)  and  the  Poisson 

€ 

jump  process  N^(«)) 

n®(t)  =  f  h  (t-s)dN  (s). 

Al.  Either  (a):  y(»)  is  stationary,  mean  zero  and  Gaussian  with  a 

rational  spectral  density  function,  or  (b) :  it  is  stationary,  bounded  and 
strongly  ♦-mixing^  [3]  with  mixing  rate  (>(•)  satisfying  |  <|»^(u)du  <  ». 

”  -  io 

Under  (Al.a),  there  is  a  stable  matrix  A^^,  matrices  and  and 
a  standard  Wiener  process  w^(«)  such  that 

(2.1)  y  -  H^Y^,  where  dY^  =  A^Y^dt  +  B^dw^, 

We  normalize  sudi  that  Covar  Yj(t)  •  I.  Define  Rj^(t)  «  EYj^(t)Yj(0)  (sta¬ 
tionary  value).  Then  R^(t)  0  exponentially  and  for  s  >  t 

(2.2a)  B[y(s) |Yj(u) ,  u  <  t]  -  HjR^(s-t)Yj(t) . 

We  also  use  the  property  that  if  5^,...,?^  are  zero  mean  and  jointly  Gaussian, 

y'»)  iis  strongly  ^-mixing  if  there  is  a  fimction  $(s)  which  goes  to  zero 
'  s  •  such  that  for  each  t  and  measurable  set  A  depending  only  on 
^(u)  ,u  ^  t,  and  measurable  set  B  depending  only  on  y(u),u  >  t+s, 

|P(B;A)  -  P(B)|  <  ♦(s). 


t 
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C2.2b)  EC.EjEjS^  =  «iC2K3'4  *  ^  S' 

Assume  (Al.b),  let  t  ^  0,  s  ^  0  and  let  y(t)  be  bounded  by  kj^. 
Then  [6] 

|E[y(t+s)ly(u),  u  l  t]|  1  2kj<|»(s) 

|Ey(t+s)y*(t+s+T)  1  £2kj<|)(T) 

(2.3a) 

E  =  I E[y(t+s)y'(t+s+T) |y(u) ,u  f_  t]  -  EyCt+s)y' (t+s+x) | 

<  4k?(t>(s) 

and 

E<4kj<t.(T). 

Hence  E  4kj<t.**(s)(t)*^CT)  . 


Let  Sj,  <  S2  <  Sj  <  s^,  and  let  y^(*)  denote  the  scalar  components  of  y(*). 


Then  the  mixing  (Al.b)  and  Eyi(s^)Ey^(s2)y„(s^)y^(s4)=0=Ey.  (s^y^  (s2)yj^(s3)Eyj^(S4) 
inq;>ly  that 

Ej  *  l^yiCsi)yjCs2)yj^(s3)yj^(s4)l  <  k(|)(s^-S3) 

Ej  <  k(|)(s2-Sj) 


Hence  E^  <  k<|)**(s4-S3)  (|.**(s2-Sj) . 

Here  and  in  the  sequel  k  denotes  a  constant  whose  value  might  change  from 
case  to  case.  Both  (2.2)  and  (2.3)  will  be  useful  for  evaluating  various  in¬ 
tegrals  in  the  following  theorems,  and  are  generally  used  without  specific 
mention. 


3.  Some  Definitions .  We  work  with  the  space  D^[0,od)  of  R^^-valued 
right  continuous  fvinctions  with  left  hand  limits,  and  the  Skorohod  topology 
[3]»[4].  Let  and  denote,  respectively,  the  minimal  (completed)  a- 

algebras  over  which  {y(s),s  <  t}  and  {y^(s),s  <  t}  are  measurable,  and 
let  E^  and  E^  denote  the  corresponding  conditional  expectation  operators. 
Following  Rishel  [7]  and  Kurtz  [8],  define  p-lim  and  A^  as  follows.  We 


say  p-lim  =  0  if  for  each  T  <  »,  ^s^;|^E  |  f^(t)[<  oo  and  E|f^(t)|  ->  0 

for  each  t.  f(»)  is  p-right  continuous  if  p-liin[f(*>+6)  -  f(0]  =  0.  Let 

6 'VO 

f  be  progressively  measurable  with  respect  to  the  family  t  <  «}.  Then 

we  say  that  fE^(A^)  and  A^f  =  g  if 

'Eif(t+6)  -  f(t) 

p-lim  - - - g(t)  =  0 

0 

and  g  is  p-right  continuous.  If  f  €  (A^),  then 


(3.1) 


M.(t)  =  f(t)  -  f(0)  -  A^f(s)ds 

i  /Ik 


is  an  ^^-martingale  [8] . 

4.  The  Convergence  Theorem  for  Double  Integrals.  In  preparation  for 
the  sequel,  consider  the  case  where  L(t,s)  =  M(t)K(s),  where  M(0  =  Mj^C*) 
and  K(*)  =  Kj^C*)  are  continuous.  Define 


(4.1) 


zj(t)  =  f  K(s)n^(s)ds 

**0 

(4.1) 

X^(t)  =  J^n^(T)»M(T)zJ(T)dT. 

Then  x^(t)  =  x^(t).  For  L(t,s)  =^M^(t)K^(s) ,  where  M^(*)  and  K^(*) 
continuous ,  define  ( •)  =  (z^C •) ,...., z^(  *) ) '  and 

(4.2)  “ 

X?(t)  =  I  n^(T) 'M^(T)zf (T)dT  ,  i  ^m. 


(4.2) 


Then 


(4.3) 


x''(t)  =  I  x\it) . 
1 


Limits  of  the  above  sequences  are  dealt  with  in  Theorem  1.  Define  R  = 


“  R(u)du,  where  R(u)  =  Ey(u)y'(0)  and  rT^ =  |Ey^(s)yj (0)ds .  Let  ^fR 
denote  the  "positive"  sqviare  root  of  the  matrix  R  and  note  (for  future 
use)  that  RCu)  =  R'C-u). 

m 

Theorem  !♦  Assume  (Al)  and  let  L(t,s)  take  the  form  jMj^(t)Kj^(s) ,  where 
are  continuoxis.  Then  i  £  m,  x^(»)}  ={X^(‘)}  is  tijd^ 

in  d’”^^[0,«>)  and  converges  weakly  to  the  process  {z^(0»  i  £  m,  x(.)}  = 
=  XC*),  where  for  m  =  1  (Writing  z=Zj,  K=Kj^  here) 


dz  =  0  + 


(4.4) 


iVi^dw, 


dx  =  I  rT.  L..(t,t)dt  +  \z'M'/ 
i.j  \  / 


where  Lj^j(t,t)  is  the  ij^*'  component  of  L(t,t),  and  w(«)  is  a  standard 
Wiener  process.  For  general  m. 


(4.5a) 


dz  '  \  K  (t) 

m  m'  ^ 


Kj(t) 


•  jV^dw 


(4.5b)  dx  =  I  Rt.L..(t,t)dt  +  JzJM!(t)>/s”  dw 


(4.5c) 


y  (s)ds/e  •♦vR  «(•)  . 


The  component  (4.5b)  equals 


(4.6)^  x(t)  »  f  I  Rt.L.  .(s,s)ds  +  f  f  0/rdw(T))  •L(T,s}V^dw(s). 

Jo  i,j  Jo  Jo 

With  the  noise  model  of  [11.  R. .  =6. ./«,  in  which  case  the  correction  term 
ifr 

is  yl  iLj^£(t,t)dt,  which  is  consistent  with  the  results  in  [1], 
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Proof.  Under  the  conditons  on  the  noise,  and  the  continuity  of  and  M^, 
the  result  follows  by  the  perturbed  test  function  method  of  [9],  [10],  and  we 
only  show  how  to  identify  the  terms  of  the  limit  operator  and  verify  the  as¬ 
sumptions  in  [10].  Reference  [10]  uses  "truncated"  processes,  but  we  ignore 
this  in  what  follows,  since  we  are  only  interested  in  identifying  the  terms 
and  assumptions  \ised  in  [lO^.  The  method  is  simple  here,  since  the  equation 
for  the  z?  is  not  "feedback",  and  the  equation  for  the  xf  does  not  de¬ 
pend  on  the  {x?,j  ^m],  but  only  on  z^(»)  and  y^(*).  For  simplicity, 
until  further  notice,  we  do  the  special  case  where  L(t,s)  =  M(t)K(s)  (i.e., 
m  =  1) .  Let  the  test  function  f(*)  have  compact  support  and  continuous 
mixed  second  partial  derivatives.  Then  (write  f(t)  =  f(x^(t) ,z^(t))  and 
X  »  (x,z),x®(t)  =  (X®(t),2^(t)) 

A^fCt)  *  f'(X®^(t))z*=(t)  +  fj^(X^(t))x^(t) 

=  £’(X*'(t))K(t)y®(t)/e  +  yx*'(t))y''' (t)M(t)z*'(t)/e. 

Fix  T.  We  define  the  test  function  perturbations  as  follows  (see  [10]  for 
more  detail) .  Define  f^(t)  »  f^(X^(t)  ,t)  ,  where 

T 

fJ(X,t)  =  7  dx  f;(X)  K(T)E|y^(T) 

X  rX 

*  7  f  (t)M(t)  z  =  i  E|G(  X  ,T)dT 

Then  fj(.)  €^(A^)  and 

rX 

A®fJ(t)  =  .G(X^(t),t)/e  4j  E|(^G(X®(t),T))dT. 

2 

Note  that,  by  a  change  of  variables  s/e  -►  s,  we  get 

T/ 

fj(t)  *  e|^^  2  £^(X)E^y’(x/e2)M(e^)z. 

which  is  0(c)  in  the  mixing  case  and  0(|yj(t)|e)  in  the  Gaussian  case. 
Such  a  transformation  will  be  used  frequently,  without  specific  mention. 
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|f«  hsv«  (with  »  X^(t)) 


(4.7) 


X®fJ(t)  »  -A®f(t) 

♦  T  dTl£;(X®)K(T)E^e(T)]^ze(t) 

+  i  dT[f'(X^)K(T)E^^CT)]^i^(t) 

+  i  dT[4(X®)Ejye’(^)M(T)2q^£E(T) 


The  integral  terns  on  the  right  of  (4.7)  are,  respectively 


T 

i-  dx  Ejy®’(t)K'(t)£^^(X®)K(T)y'=(T) 
f  T 

-41  dx  E®  {y^'(t)K'(t)£^^(X^)y^'(x)M(x)z«=+  £^(X^)y^' (t)K« (t)M' (T)y*=(x) } 
C4.8)  ^  ^ 

^  4  dx[f^^OC^K(x)E^y®(x)]y®'(t)M(t)z^  ^ 
rT 

-4  dT[f^(X^E^^'(x)M(x)fl/^'(t)M(t)z^  . 

Let  f ^(xfy®(t) ,t)/e^  denote  the  sum  of  the  terms  in  (4.8).  Define  the  sec¬ 
ond  test  function  pertuxhation  £|(t)  by  f|(t)  =  f|(X®(t) ,t) ,  where 

/T 

fjCxSt)  “  4  dx[E|f^X  ,y'=(x).x)  -  E  rtx,y®(x),x)|^^^e] 

Also,  f|(t)  €^(A^)  and 

A^£|(t)  =  -FtxSy^t),t)/e^  +  EF^(X,y®(t),t)/6^|jj^jje 
+  f^(xSy^(t))^  i"  +  £2(X^y^(t))•z^ 


Define  the  (time-dependent)  diffusion  operator  A  by 

Af(X)  »  lim  \  h?^(X.y^(t)  ,t) 

T  j 

»  lim  f  dT  Ery(t/e2)K’Ct)f  (X)K(e2T)y(T) 
e*0  Jt/e2  I 

(4.9)  +  [y(-^)K'(t)f^(X)y*(T)M(e2^)z  +  y'(T)K»(e2^)f^^(X)y(t/e2)M(t)z] 

+  yx)y'(t/e2)K'(t)M'(e2T)y(T) 

+  (y’  (T)M(e2T)  2)  (y.  (t/e2)M(t)z)|. 

The  limit  of  the  "f  component"  on  the  ri|^t  of  (4.9)  is  trace  R*(K'f  K)/2. 

zz  zz 

The  limit  of  the  "f  connsonent"  is  f "  (X)  7  L..(t,t)Rt..  The  limit  of  the 

X  X  ^  ij'  *  '  13 

"f  "  and  .f  components  are,  respectively,  f  (X)(z'M'RMz)/2  and 

XA  AZ  Za  XA 

trace  R  •  (K'f  (X)z'M’+Mzf^  (x)K]/2.  Note  that  (4.4)  is  the  unique  solution 
aZ  xz 

X(<)  to  the  martingale  problem  (of  Stroockand  Varadhan)  for  the  (time  depen¬ 
dent)  operator  A. 

Now,  ve  relate  these  results  to  those  of  [9] , [10] .  Define  the  perturbed 
test  fimction  f *^(t)  ■  f ^(t)  +  f j(t)  ♦  f2(t) .  In  order  for  X^(  •)  ^  X(  •)  in 
D^^[0,*)  the  results  of  [10]  require  that  (4 . 10a) to  (4 . lOd)  hold  for  each 
test  function  f(*)  and  each  T  <  ••  and  with  X^(0  varying  in  an  arbitrary 
bounded  set. 

(4.10a)  p-lim  fj  «  0  ,  i  -  1,2 

(4.10b)  sup  P{sup|ff(t)  |>N}-^0  as  N-^». 

e  t£r  ^ 

(4.10c)  f^€S(A®) 

p-lim[A®f®  -  Af]  -  0 


(4.10d) 


The  method  of  [9]^ [10]  reqiilres  (4,10a,b,c)  for  i  =  1  to  get  tight- 
ness  of  {X^(*)}  in  All  the  conditions  in  (4.10)  are  then  used 

to  identify  the  operator  A  and  to  get  X^(*)  ’*  X(*),  the  unique  solution 
to  the  oartingale  problem  for  operator  A. 

Under  (Al.a),  ff(t)  =  0(eb  [  |Ye(t)|i+  1]  and  |X^f®(t)  -  Af(x^(t))  |  = 

■  0(e)[|Yi®(t)|^  +  1].  and  P{  sup  ,E|Yf(t)  |^>  a>0}  -5  0  for  each  a.  Under 
(Al.b),  these  estimates  hold  without  the  Y^Ct)  term.  Thus  (4.10)  holds,  and 
the  theorem  is  proved  for  m=l. 

- -  xhe  general  case  (m  >  1)  follows  from  this  -  sinqjly  use  the  definitions 

(Kj^, . . .  ,K^)  , =  (Mj^, . . .  ,M^)  ,  »  (Zj,.,.,z^  and  replace  K,  M  and  z^ 

by  S4ffJt  and  Z^,  respectively.  Q.E.D. 

Weakwiing  the  assumptions  (Al) .  Let  y|(0 » • • • »y^(*)  be  the  zero  mean 
scalar  components  of  the  right  continuous  vector  valiied  y^(*)  and  let  n^(*)  * 
y*^(*)/e*  Define 


(4.11) 


|(S)  ds/e 


|'^lEjyf(s)yJ(T)  -  Eyf(s)ye(T)]ds/. 


1 2 


<  00. 


Suppose  that 


Let  sup  E|y|(t) 
t  <0®,  e>0 

uniforaly  in  t  <  T,  e  >  0,  and  for  each  t<T  converges  to  a  limit  (not  de- 


f(t)ds/e^  is  bounded 


pending  on  Tort)  as  e>**-0. 

It  is  apparent  from  (4.10)  that  (Al)  can  be  weakened.  To  verify  (4.10a,b) 
in  general,  for  the  f®  constructed  in  the  theorem,  we  need  only  that  (4.10a,b) 


hold  for  each  of  the  fj^^  and  f|j^j  of  (4.11) .  The  term  A^f*^  contains  an  x- 


gradient  of  f2(x,t)  (with  x  then  set  equal  to  X^(t))  times  X®^(t).  Thus, 


1 

A  r  « 


to  gel(4.10d),  we  need  that  additionally  p-lim  ^[^2ij ^  ® 

i,j,k.  Condition  (4.10c)  will  also  hold  under  these  conditions.  These  condi¬ 
tions  are  satisfied  under  (Al) . 


lEBMB 
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The  perturbed  test  function  method  was  used  in  Theorem  1,  since  reference 
can  readily  be  made  to  it.  In  Chapter  5  of  [11]  an  alternative  method  (called 
there  the  "combined  perturbed  test  function-direct  averaging  method")  is  de¬ 
veloped.  With  use  of  that  method  for  proving  weak  convergence,  and  for  the 
case  y®(t)  »  y(t/e^) ,  (Al)  can  be  replaced  by  (4.12) 

r 

A<1  ^t+A 


(4.12a) 

(4.12b) 

(4.12c) 

(4.12d) 


2  I  2 

{ly(t)|  ,  sup  1 1  E^(u)du|  ,  t  <  «,  T  <  »}  uniformly  integrable 
A<1 

f’^ 

j  E^y(u)du  continuoiis  in  probability,  uniformly  in  t^T,  for  each  T. 
[  E  y(u)y(s)  *du  converges  as  t-s  «» 

Js 

Elj  du[E^y(u)y*(s)-Ey(u)y*(s)]l  -►0  as 


These  conditions  (which  are  just  (5.8.20)  to  (5.8.23)  in  [11])  are  rather  unre - 
strictive,  as  are  the  requirements  associated  with  (4.11).  In  fact  (4.12)  is 
implied  by  (Al) . 

Theorem  2.  Assume  the  model  (4.2),  (4.3)  and  contition  (Al) .  The  process 
defined  by  (  y^(u)du/e  converges  weakly  to  V^w(»).  Let  M,  and  K.  be 

Jo  ^  ^ 

in  L2[0,T]  for  each  T  <  »,  but  not  necessarily  continuous.  Then  zf  ^  z^^ 
of  (4.5)  and  the  finite  dimensional  distributions  of  x^(»)  converge  to  those 
of  (4.5).  If  the  Mj^(«)  are  bounded  on  each  [0,T],  then  the  weak  convergence 
of  Theorem  1  continues  to  hold. 

Proof.  The  first  assertion  is  from  Theorem  1.  It  is  sufficient  to  work  with 

m  ■  1.  The  value  of  the  constant  k  (depending  only  on  T)  mig^it  change  from 

one  usage  to  another.  For  notational  siiiq)licity,  we  consider  only  the  scalar 

and  Gaussian  case  (which  is  slightly  harder  than  the  (^-mixing  case,  since 
y(*)  is  unbounded).  In  the  ^-mixing  case,  we  simply  replace  (4.14)  by  in- 
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>  ^',^1 


i 


i 


m 


equalities  derived  froa  (2.3). 


Part  1.  Ne  have 


A  1  ft^3 

(4.13)  E|z®(t+6)-z®(t)p  *■^1^  dt^dt2dt3dt4K(tj)...K(t4)Ey^(tp...y^(t^) 


Define  R®(t)  »  (|R(t/e2)|  +  |R(-t/e2)  p/e^,  for  |t|  <  ».  Then 


(4.14) 


|Ey®(t^) . .  I  <  enR®(t2-ti)R®(t4-t3) 


+  R*=(t3-tj)R^(t2-t^)  +  R®(t^-t^)R^(t2-t3)], 


Define 


(4.15) 


P*  |K(s)  |R®(T-s)ds  =  K  (t).  Then 

Jt  ® 

rt+d  j  ft+6  rt+6 

J  K‘(T)dx  =  I  dT(J  |K(s)|R^(T-s)ds)‘ 

ft+6  /t+4  9  ^  r® 

<  dT(j^  r(s)R®(T-s)ds)J^R^(s)ds 


K  (s)R®(T-s)ds)  R''(s)ds 

Jo 


The  expression  (4.13)  is  upper  bounded  by 


rt+6  2 

|K(t)IK  (T)dT)^ 


rr+o 

h(J^  |K(t)I1 


Then,  by  the  Schwarz  inequality  and  (4.15) 


(4.16a) 


[ti 

(4.13)  <  k(J^ 


l;^(s)ds)‘. 


But  ([3],  Theorem  12.3),  (4.16a)  iiiq>lies  that  {z^(*),  e>0}  is  tight  in 
C^[0,<»)  for  each  K.  Also  for  each  5  >  0  and  T  <  ca,  (4.16a)  iiq>lies  that 


(4.16b) 


sup  p{sup|z^(t)  |>6>0}-+-0  as  ||K||-^0. 
e>0  t<T 


£  2 

Part  2.  Let  us  next  evaluate  E(x  (t))  ; 
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B(x«(t))2  -  EEp  dx  y®(T)M(T)r  ds  y^(s)K(s) l^/c** 

io  Jo 

(4.17)  <  |^dSjds2dS3dS4|M(Sj)llM(s2)|lK(s3)llK(sp|  . 

.[R®(S2-Sj)R®(s^-S3)+  R®(s3-Sj^)R®(S2-S4)+R^(s4-spR^(s3-S2)] 

Let  us  evaluate  the  part  of  the  integral  on  the  ri|^t  of  (4.17)  containing 
R®(s3-Sj)R®(s2“S^)  only.  Write 

MgCx)  -  p|M(s)|R^(T-s)ds. 

Jo 

Then  Mg(T)dT  <  k  |^(H(T)pdT,  and  similarly  for  K(.).  Using  this,  we 
obtain  that  the  tern  is  bounded  above  by 

fV(S3)|K(s3)|ds3  P  K^(S2)|M(S2)|ds2 

(4.18)  °  ° 

Via  a  similar  analysis,  we  obtain  that  the  otiier  terms  of  (4.17)  are  also 
bounded  by  the  rif^t  side  of  (4.18). 

*•  '•“mm 

Part  3.  Let  IL  be  cwitinuous  for  each  n,  and  define  6M  «  M  -  M„, 

.  11  II  n 

where  ll^ull  ‘♦’.O*  Define  x*  by  k^(0)  *0  end 
(4.191  ij  - 

Then 

(4.20)  X®  -  MzV®/e  -  M®x®y®/e  ♦  6MjjZ®y'^/e, 

Using  the  tightness  of  {z®(*))>  en  argument  like  that  in  Theorem  1  can  be 
used  to  obtain  that  {z®(0  »x®(*) .  e>0}  is  ti|^t  in  D*^*^(0,«»)  for  each  n 
and  that  the  weak  limit  satisfies  (4.4)  with  M  replaced  by  M^. 


Now,  applying  the  estiaate  in  Part  2  to  the  case  where  6M^  replaces  M,  we 

get 

Slip  E(|  ds6M„(s)z®(s)y®(s)/e)^  »  sup  Elx^(t) -x^(t)  |  ^  -*-0  as  n  -*>  ». 
c>0  h  "  e>0  "  I 

The  second  assertion  of  the  theorem  follows  from  this  and  the  above  cited 

weak  convergences. 

Part  4.  Let  be  bounded  on  [O.T],  Again,  it  is  sufficient  to  work 

with  n  ■  1.  Write  M»  and  define  as  ia  Part  3.  Define  x^(t)  = 

x®(t)  -  x^t)  »  f  ds6M_(s)z^(s)y®(s)/e.  To  prove  the  last  assertion  of  the 
n  iO 

theorem,  we  need  only  prove  for  each  T  <  «>  and  6  >  0,  that 

(4.21)  lim  P{sup|x®(t)|  >  6  >  0)  -»•  0 

e>0  t^  “ 

as  -►O*  where  we  can  assume  that  and  M(0  have  a  conmon 

finite  upper  bound.  Since  {z®(.)>  is  ti^t  in  D^[0,«o)  by  Part  1,  by 

changing  the  value  of  z^(  0  (for  each  e  >  0)  on  a  set  of  arbitrarily  small 

probability' we  can  suppose  that  there  is  an  N  <  »  such  that  sup|z^(t) |  <  N. 

.  . .  “  t_^ 

If  (4.2i)  holds  with  this  bound,  where  N  is  arbitrary,  then  it  holds  as  stated. 

Henceforth,  we  let  |z^(t)  |  be  bounded  by  N  and  absorb  N  into  the  constants 

k,  where  appropriate. 

2 

A  "perturbed  Liapiniov  function"  method  will  be  used.  Define  N(x)  >  x  . 
Then  ^W(x®(t))  *  2x®(t) z^(t)6M^(t)y^(t)/E.  Recall  that  R(t)  =  HjRj(t)  and 
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define  R^C»)  as  in  Part  1.  Define  the  perturbation  W^*"(.)  and  W^'"(.) 
by  (write  R  =  *  *  z^Ct),  where  convenient)  by  W^'"(t)  *  W(x)  + 

+  W®*"(t) ,  where 

X 

Wj'"(t)  =  I  2xz«M^(s)E^y*=(s)ds/e 
/T 

=  i  J^2xzdMj^(s)H^Rj(^)Y[(t)ds. 


Define  fiM^(t) 


(T 


(s)  |R^(s-t)ds,  Since  6M^(*)  is  boimded  on  [0,T], 


unifomly  in  e  and  n,  we  have  (change  variables  s/e^  -»•  s,  and  recall  that 
we  are  assuming  that  z^(t)  is  bounded) 

I  _  I  I  i 


|Wj»"(t)|  <keix|6M^(t}  |Yf(t)| 


(4.22) 


<  kelx]^  +  kelYj(t)  f  .\)6M^(t) 


Define  F(x,z,s,t)  =  2xz6M^(s)E|y^(s)/e.  Then  (for  almost  all  t) 

f  X 

A®WJ*"(t)  *  -2xz6M^(t)y®(t)/e  +  j  F^(x,z,s,t)ds  x^(t) 

*  j^Pz(^*z»s»t)ds  z®(t). 

Thus  (to  obtain  the  second  line,  change  variables  s/e^  -*■  s  and  use  (Al)) 

A®w‘'*"(t)  -  ^  ds6M^(s)E^^s)[iK(t)y^(t)  ♦  z26M^(t)y^(t)  ] , 

(4.23)  ElA-H^'^t)!  <k  «M^(t)lK(t)lE*S|x|2  +  k«Me(t)  ] 6M^(t)  1 

<  k|fiM®(t)|^  lK(t)l^  +  kElx|^  +  k  6M®(t) 1 6Mn(t) 1 

The  expression  F^*”(0  in  (4.24)  is  a  martingale,  with  F^(0)  •  0  (see 
Section  3) . 

F®’"(t)  -  W®^'"(t)  -  r  A®W^»"(s)ds. 

Jo 


(4.24) 
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I' 

•i' 


I 

a/ 


1, 


L. 


Taking  expectations  in  (4.24)  and  using  the  bounds  (4.22),  (4.23)  and 
|^6M®(t)  |6M^(t)  |dt  £  yields  (for  t  ^  T) 


^  T 

(4.25)  E|xJ(t)|^  ^  kJ^E|x^(s)|^ds  +  kl|6M^|l^  +  k|  (6^^(t)) ^K^(t)dt  +  ek 


Note  that  sx^  sup  S>f(t)  is  bounded  and  that  5M®^(»)  zero  function  in 
t>0  t<T  ” 


measure  (uniformly  in  e  -»■  0)  as  n  -►  «.  This  and  (14.25)  imply 


T 

(4.26)  ra  sup  E|x®(t)|  <  »  k[||6M„||^  +  f  (6M^(t))  V(t)dt]  5  0. 

e>0  t<T  "  ■'0 


Since  F^*”(«)  is  a  martingale. 


(4.27) 


P{sup|F^»"(t)l  >  a  >  0}  <  E|F®*"(t)|/a. 
t<  T 


We  have  for  each  b  >  0 


(4.28)  ITmP{supl[  A®W^*"(s)ds|  >  b  >  0}  <  pf  |A*i»®*"(s)  |ds/b  <  k4  /b^ 
e>0  t^T  Jo  Jo  -  n 


lim  P{  sup-e|Y(t)|^  >  b  >  0}  ®  0  . 
e>0  t^/e^  1  “ 


The  boind  (4.22)  and  estimates  (4.28)  siibstituted  into  (4.27)  yield  (4.21).  Q.E.D. 


Theorem  3.  Assune  (Al).  For  the  general  form  (1.1a)  where  m  ®  <»,  the  fi¬ 
nite  dimensional  distributions  of  x^(»)  converge  to  those  of  (4.6),  where 


L(t,t)  =  J  Xj^M^(t)Kj(t)  and  |  y*^(s)ds/c  •A^^(0  •  Assume  (Al.b),  and  let 
the  be  uniformly  bounded  on  each  finite  time  interval.  Then  (4.6) 


is  the  weak  limit  of  {x^(0}  in  D[0,eo). 


Proof.  Part  1.  In  view  of  Theorem  2,  for  the  first  assertion  it  is  suffic¬ 


ient  ot  show  that  for  each  t  <  <», 


(4.29) 


^\lh  r  y®(T)*M  (T)dTrK.(s)y^(s)ds/, 

n  Jo  Jo 
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as  n  -►  oo,  uniformly  in  e  ->  0.  We  only  outline  the  (straightforward)  calcu¬ 
lation  in  the  scalar-Gaussian  case.  In  this  case. 


The  evaluation  now  proceeds  as  in  Theorem  2,  part  2,  to  yield  the  bound 


n  n  ~  n 

second  assertion,  in  view  of  Theorems  1  and  2,  it  is  sufficient  to  assume 


and  to  show  that  for  each  T  <  »  and  6  >  0 


'  q)lify  the  notation,  let  all  the  K^,  M^,  Xj^,  be  scalar  valued.  The 


1  i  on  K.,  will  be  absorbed  into  the  k  and  0(e)  below.  A  per¬ 


co  .t 

(4.29)<niVjl  ds^ds2ds3dS4lM.(spK.(s2)M.(s3)K.(spl  • 

•  [R®(S2-Sj)R®'(s^-S3)  +  R^(S3-Sj)R^(S2-s^)  +  R^(s4-spR^(s3-S2)] 


(4.29)  <ll  A.A.llMjl  llM  II  ||KJ|  |  |K  |  | 
n  ^  ^ 

1  d  \llMilI  IIkJI)^  5  0. 

n 

00  00  eo 

Part  2.  Note  that  j;|A^xf(t)|  iI|a^|+5;|a^|  |xf(t)  |^.  Thus  for  the 


sup  p{sup  X  A, Ixf(t) ^  6  >  o)  ^  0. 
e>0  t<T  n  ^  ^ 


turbed  Liapunov  function  argument  of  the  type  used  in  Theorem  2,  Part  4,  will 
be  employed.  First  we  show 


sup  P{sup  J  A.  |zf(t)  I  ^6  >0)^0 

c>0  t<r  n 


OD 

sup  sup  E  J  A. |zf(t) 1^  ^  0. 

c>o  t<r  - 


n 


Define  V^(z)  =  I  and  V^(t)  =  Vj^(z^(t)).  Then  A^V^(t)  = 

2  XAj^zf(t)Kj^(t)y^(t)/e.  Define  the  perturbation 

fT 

«v'(t)  '  I  J  I  Xjzf(t)Kj(s)Ejy'Cs)ds. 


•■V"*  V  vrl  'V*  .^V  •IT*  -  •  .  •  ^  V  .  • 
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'  '  '  1 


Define  ^(t)  *  V®i.t)  +  SV^(t) .  Under  (ALb)  we  have 

|6V^(t)|  =  0(e)  J  Xjz^(t)| 
n 

1  0(e)  I  X.[l+|z^(t)|2|, 


n 


^  r  i  XjK.(s)K.Ct)/(t)E^y'Cs)ds 

=  0(1)  I 

n 

Also  V^(t)  -  I  A'^^(s)ds  is  a  martingale.  Now,  following  the  procedures 
n  Jq  n 

in  Theorem  2,  Part  4,  we  obtain  that  for  each  6  >  0 


(4.32) 


sup  E  J  Xj^|Zi(t)|^  <  k  Ix^ 
t<T  n 


n 


sup  P{sup  T  Xi|zf(t)|^  >  6  >  0}  5  0. 
e>0  t<T  n  ^ 


2 

Next,  the  procedure  is  repeated  for  W^Cx)  =  J  X^|x^(t)|  .  We  have 
^  »  n 

A®W^(x®(t))  =  2^  3C?(t)M^(t)zf  (t)y^(t)/e.  Define,  the  perturbation 

n 

6Wj(t)  *  f  r  I  XiZ^(t)M^(s)x^(t)Ejy'=(s)ds 

n 

and  set  W®(t)  =  W^(x^(t))  +  ^W^(t) .  Now  (Al.b)  implies  that 

|«Wj(t)l  =  0(c)  I  X.lz®(t)l|y^(t)l 
n 

<  0(c)  I  Xi[|i'(t)|^  .  |x=(t)|^]. 
n 

Analogously  to  the  procedure  of  Theorem  2, 

A®Wj(t)  =  Tds  J  X.M.(s)E^y^(s)[(zJ(t))V(t)  +  xJ(t)K.  (t)  ]y'^(t) 
n 

\^%W  \  <  k  I  Xj(z^(t))2  ^  lx^(t)l]. 


As  for  the  above  case  for  V^(z  ),  these  estimates  and  the  martingale  pro- 


rt  ^ 

perty  of  W^(t)  -  J  AVCs)ds  yield 


(4.33) 


sup  E  J  X.  lx?(t)  1^  £  sup  k  E  I  xJz-Ct)  1"^  ^  k  X. 
t<T  n  t<T  n  n 


This  and  the  above  martingale  property  yield  the  derived  estimate  (4.30), 


similarly  to  what  was  done  in  Theorem  2,  Part  4.  Q.E.D. 


5.  An  Application  to  the  Approximation  of  a  Likelihood  Ratio, 


We  work  with  the  system 


dx  =  Axdt  +  Cdw, 


(5.1) 


dy  =  Hxdt  +  dw2 


where  Wj^(.)  and  ^2(0  are  standard  and  mutually  independent  Wiener  pro¬ 


cesses.  The  x(*)  and  y(»)  here  are  not  the  same  as  those  in  the  pre¬ 


vious  sections.  Let  3l(t)  =  Elx(t)|y(u),  u  <  t] .  Then  on  each  [0,T],(the 


likelihood  functional)  Radon-Nikodyn  derivative  of  the  measure  of  (5.1)  to 


that  of  (5.2)  is  the  F(.)  of  (5.3) 


dx  =  Ax  dt  +  Cdw, 


(5.2) 


dy  =  dw2. 


F(t)  =  exp  f(t). 


(5.3) 


f(t)  =  4  r|Hx(T)l^dT  +  f  dy'(T)Hx(T)dT. 

Jo  Jo 


dx  B  Ax  dt  +  G(dy  -  HSc  dt) 


=  (A  -  GH)  X  dt  +  Gdy , 


IWfli 


Esgggi 
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where  G(«)  is  obtainable  from  the  splution  to  the  Riccati  equation.  We  can  write 
(5.4)  x(t)  =  4(t,0)x(0)  +  P  4(t,s)G(s)dyCs)  =  f  U(t) V(s)Hx(s) ds 

Jo  Jo 


f 

Jo 


U(t)VCs)dw2(s) 


+  4'(t,0)x(0) , 

where  *(•,•)  is  the  fundamental  matrix  of  v  =  (A  -  GH)v,  and  U(*)  and 
V(.)  are  continuous.  The  second  integral  of  (5.3)  equals 

(5.5)  P  dT[Hx(T)]'  H  r  U(T)V(s)[Hx(s)ds  +  dw-(s)] 

Jo  Jo 

+  P  dw.(T)'  H  P  U(T)V(s)Hx(s)ds 

Jo  ^  Jo 

+  dw'(T)  H  U(T)V(s)dw2(s)  +  |^[dw2(T)+Hx(T)cTj'HU(T)V(0)x(0) 

Consider  the  problem  where  "wide-band”  noise  replaces  the  ideal 

infinite  band-width  white  observation  noise  ^2(0.  and  where  i);^(»)  =  i()(t/e^) 
and  i|>C»)  satisfies  (Al) ,  and  ir  independent  of  Wj^(.).  Under  (Al) ,  jij;^(s)ds/e 
-»W2(»),  a  Wiener  process  with  covariance  Rt.  W.l.o.g.,  assume  R=I,  since  the  com¬ 
ponents  of  the  obsemration  noise  in  (5.1)  are  mutually  independent.  In  the 
general  case,  simply  replace  all  dw2  byV^  dW2.  As  in  [1],  an  important 
approximation  and  limit  problem  arises,  since  we  must  use  the  "physical" 
wide-band  noise  [i|»*^(s)/e]ds  in  lieu  of  the  ideal  dw2(s)  in  (5.5).  Re¬ 
place  dW2(s)  and  dw2(T)  by  [t|)^(s)/e)ds  and  [i(»*^(T)/e]dT,  respectively, 
in  (5.1)-(5.5).  Let  x®’(»)  denote  the  value  of  (5.4)  obtained  with  this  re¬ 
placement.  Then  both  {x^(.)}  and  the  first  two  integrals  of  (5.5)  (with  the 
i{)-replacement)  are  tight  and  converge  weakly  to  (5.4)  and  those  integrals. 
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Also,  the  limit  W2(*)  is  independent  of  Wj(»).  The  only  problem  is  the 


3rd  integral  of  (5.5),  which  we  rewrite  (with  the  <1'  replacement)  as 


(5.6) 


-4-  P  dr  i|/^’(T)Hr  U(T)V(s),j,®(s)ds  =  u^(t). 

®  Jo  Jo 


Write  dy®(t)  =  [Hx^(t)  +  \(»^(t)/e]dt  and 


=  V*^/e  ,  z'-(O)  =  0 


(5.7) 


HUz^/e  ,  0*^(0)  =  0 


Theorem  1  can  be  immediately  applied  to  yield  that  {z^(*) ,u^(») }  converges 


weakly  to  (z(.),u(.)),  where 


(5.8) 


dz  =  Vdw-,  rT.  =  [  Ei|).  (s)i().(0)ds 
iJ  J  0  ^  J 


du  =  j  I  (HU(t)V(t))^^Rtjdt  +  z'U'H'dw2 


In  general ,  rT .  need  not  be  zero  for  i  ^  j .  In  the  special  case  where 
^  J 


the  {i|/^(*)}  are  mutually  independent  and  R  =  I,  we  get  rT^  =  and 


(5.9)  u(t)  *  ^  P  ti^ace  HU(s)V(s)ds  +  dW2(T)HU(T)  £v(s)dW2(s) 


Define 


f®(t) 


=  -|  lHx^(s)l^ds  +  p  [Hx(s)+i|;^(s)/e]Hx^(s)ds 

-  4  P  X  (HU(s)V(s)). .Rt.ds  , 

“'  0  ij 


F®(t)  =  exp  f^(t) . 


By  our  results,  the  system  {x(«)  ,ii®(»)  »y^(0  »F^(0  }  converges  weakly  to  the 
system  {x( .)  »x(  •)  ,y(  0  »F(  0  }  as  e  -►  0. 
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Remarks .  F^(*)  is  not  a  likelihood  functional.  But  the  simultaneous 

weak  convergence  of  the  system  and  functional  just  cited  implies  that  it  can 
be  used  in  statistical  tests  (for  small  c  >  0) ;  for  example  in  a  hypothesis 
test  for  testing  whether  H  takes  the  value  or  0  (signal  or  no  signal, 

respectively) .  This  is  because  for  each  a  >  0 


P{F®(t)  >  a|H  =  Hq}  4P{F(t)  >  a|H  *  Hq}  . 

Then,  the  use  of  F®(»)  yields  an  "approximation"  to  the  test  which  we  would 
have  under  the  assumption  that  ^2^’^  vere  the  actual  observation  noise.  The 
weak  convergence  is  important  if  the  test  is  to  be  meaningful  -  the  conver¬ 
gence  of  finite  dimensional  distributions  (as  obtained  in  [1])  is  not  actually 
enou|^,  because  it  is  essential  that  the  "system"  x^(.)  approximate  x(*) 
also,  for  otherwise  we  do  not  have  an  approximation  to  a  likelihood  functional 
for  a  particular  system. 

Owing  to  the  nature  of  weak  convergence,  the  distributions  of  the  passage 
times  of  F®(0  through  any  given  level  also  converges.  Thus,  the  results 
can  also  be  used  for  a  sequential  test.  A  weak  convergence  type  of  result 
is  essential  for  this.  It  could  not  be  done  if  only  finite  dimensional  dis¬ 
tributions  converged.  We  end  by  remarking  again  that  the  procedure  works 
with  many  other  types  of  noise  processes. 


6.  Approximation  of  Multiple  Integrals  (order  >  2) 

In  order  to  siiiq>lify  what  would  otherwise  be  a  very  awkward  notation, 
let  y(*)  and  L(*)  be  scalar  valued.  We  seek  the  (weak)  limit  of 

(6.1)  x^(t)  »  dSjjj  1^”  dSj^.l---|^^ds^L(Sj,...,Sjjj)ye(Sj)...ye(sJ  /g“. 
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itfhexe  y^(t)  ■  y(t/e^).  Retain  (Al) ,  although  the  condition  can  be  consider- 

e ,  »  ,  .  .  .  „  e 


ably  weakened.  Also  the  Hy  (s^^)  can  be  replaced  by  if  the  set 

{y^C* )  » • . .  »yji|(* )}  satisfies  (Al)  .  Only  an  informal  outline  will  be  given. 


We  first  let  L(S|,...,s  1  s  n  L.(s.)>  where  each  L.(«)  is  continuous. 

X  uT  ^  1  X  X 

Define,  recursively,  :^(t)  =  1  and  (x^CO)  »  0  for  i  >  0) 


•e  ,e  e  ,  ,  e  e  / 

*1  “  ^1^  “  ^1*0^  ^ 


(6.2) 


e  £ 


*2  “  *'2^1^ 


•e  ,  e  e , 

X  =  L  X  ,y  /£• 
m  m  m-l'^ 


Then  3C®(»)  »  x^’C*).  Either  the  method  of  Theorem  1  or  the  (preferable  "di¬ 


rect  averaging")  method  mentioned  after  Theorem  1  can  be  used  to  obtain  the 
correct  limit. 

e 


Theorem  4.  Under  (Al) ,  {x?(*) ,  i  ^  m)  (x. (•) ,  i  ^  m)  ,  where  (R  =  j  R(u)du, 

.  ^  ^  d  _O0 

and  w(*)  is  a  standard  Wiener  process) 


dxi' 

^  0 

'4  ’ 

(6.3) 

dX2 

e 

• 

s 

+ 

Vi 

• 

n 

L  .X  ^dXjT, 
n  m-i 

,  4 

V.n-1, 

dw 


Remark .  The  "correction  term"  is  more  complicated  here.  It  can  be 


obtained  directly  by  solving  (6.3)  for  Xj|j(*)-  The  correction  term  is  the 


sum  of  all  the  terms  in  x  (t)  except  for  the  m-dimensional  Ito  integral 

n 


4CSi)dw(s.) 

JoJo  Jo  ^ 


f®2« 
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The  proof  is  essentially  the  saae  as  that  of  Theorem  1  and  we  only 
make  a  few  remarks. 

To  use  the  method  of  Theorem  1 ,  choose  a  test  function  f (x, , . . . ,x  ) 

1  III 

whose  second  partial  derivatives  are  continuous  and  which  has  compact  sup¬ 
port  .  Th«i  (write  x^  ■  x|(t) ,  where  convenient) 


f(Xj,...,XjP  ■  J  *  I  ^x^f*l»** 


AnalogouS^o  the  method  of  Theorem  1,  define  the  perturbaticms  fj(t) 
and  f®(t)  -  f(xj,...,x®)  ♦  fj(t)  by 


fjCt)  ”  7  I 


Then  (analogously  to  the  case  in  Theorem  1) 

m  rT 


(6.4) 


+  T  J  It  ^i-1 


which  equals  (change  variables  s/t^  -*■  s  and  substitute  for  xp 
m  fT/e^ 


“  f  1/  e  c-  <■  .. 

.11,  J  .  ,  *X.X.<*1 . »S)xr.iI.i(e^s)E'y(s)d»[L  (t)/(t)xf.,] 

i,j«l  i  j 

(6.5)  »  rT/e^  _  _  ■  c.  P 

*l  [  f  (x5,...,x®)L.(e2s)E®y(s)ds[L._,(t)xf  2y  (t)]. 

i:2  U/e^  H  ^  ^  ^ 


To  obtain  the  operator  A  of  the  limit  process,  take  expectations  in 
(6.5)  and  let  e  0  to  obtain  (the  time  dependent  operator). 


C«-«  *«*1 . *m>’I  . 


This  is  the  operator  of  (6.3).  The  component  with  the  £  yields  the 
"correction  term". 

Now,  let 

(6.7)  L(s  ,...,s  )»  I  “  lUs.-)  ~  I  L^(s.,...,s) 

*  “  j=l  i*l  ^  ^  j=l  ^  ® 

where  the  L^(*)  are  continuous.  The  procedure  is,  again,  an  extension 

of  that  of  Theorem  1.  Each  integral  (for  n) 

is  "state  variabilized"  and  treated  separately,  except  that  the  limit 

Wiener  process  w(.)  does  not  depend  on  j  here-since  the  y^(.*j) don't 

n  * 

aepend  on  - )  here; '  Thus  x®(t)'  4  x^*)^  I  xjj(t) where 

'  .  j=l  ® 


R  LjLjxJdt/2 


and  xj  s  1,  xj(0)  -  0  for  i  >  0. 


vr 


^2^1  I  dw 


L^x^ 
m  m-1 


Theorems  2  and  3  hold  also,  when 


L(s^,...,s^  -  I  J j  lJ(s.) 


and  JUj^j  <  •  and  the  {Lj^}  are  uniformly  bounded  in  L2[0,T].  for  each 
T  <  w.  The  extension  of  the  last  assertion  of  Theorem  2  requires  hrnmdedness  <• 
of  each  L^(0  for  i  >  1. 
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